NEW LATTICE POINT ASYMPTOTICS FOR PRODUCTS OF UPPER 

HALF PLANES 



R.W. BRUGGEMAN, F. GRUNEWALD, AND R.J. MIATELLO 

Abstract. Let T be an irreducible lattice in PSL2(R)'' (d e N) and z a point 
in the li-fold direct product of the upper half plane. We study the discrete set 
of componentwise distances D(r, z) c W' defined in (1). We prove asymptotic 
results on the number of y 6 F such that d(z, yz is contained in strips expanding 
in some directions and also in expanding hypercubes. The results on the counting 
in expanding strips are new. The results on expanding hypercubes improve the 
existing error terms (|6|) and generalize the Selberg error term for d= \. 

We give an asymptotic formula for the number of lattice points yz such that 
the hyperbolic distance in each of the factors satisfies d((yz)j, Zj) < T. The error 
term, as T — » oo generalizes the enw term given by Selberg for = 1, also 
we describe how the counting function depends on z- We also prove asymptotic 
results when the distance satisfies < d((yz)j,Zi) < Bj, with fixed < in 
some factors, while in the remaining factors < d((yz)j, Zj) < T is satisfied. 
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1. Introduction 

Let 9> = { x+iy € C : y > 0}he the upper halfplane equipped with the hyperbolic 

metric J : § x § — > R and its invariant measure induced by The group of 

y 

orientation preserving isometrics of this metric space is PSL2(R). Let now dhe a 
natural number and consider the semisimple Lie group PSL2(]R)'^ as acting on its 
corresponding symmetric space We write z = {zi, ■ ■ ■ ,Zd) for the coordinates 
Zi , . . . , z^/ € § of a point z e Let us consider the vector valued distance function 

(1) d{z,u) := {d{zi,ui),...,d{zd,Ud)) e R'' 

for points z = (zi, - ■ ■ ,Zd), u = {ui, . . . , u^) € The canonical invariant distance 
of z, u is then the euclidean norm of d{z, u). But other choices of norms (like the 
maximum norm) also induce PSL2(R)^-invariant metrics on 

Let r c FSLiCR)'' be an irreducible lattice. A lattice in PSL2(R)'' is a discrete 
subgroup r c SL2(R)'^ of finite covolume, that is, the volume of the quotient r\§'^ 
in the canonical measure is finite. The lattice T c SL2(R)'^'' is called irreducible if 
all projections of F to non-trivial subproducts of PSL2(R)'' are dense. A main ex- 
ample is the Hubert modular group PSL2(<9) for the ring of integers (9 of a totally 
real number field F of degree d over Q, embedded in the product PSL2(R)'' by the 
d embeddings of F into R. The embedded group PSL2(<9) and all its subgroups of 
finite index are irreducible lattices in PSL2(]R)''. They are not cocompact, which 
means that the quotient r\§'^ is not compact. In case d >2 every irreducible lat- 
tice in PSL2(R)^ which is not cocompact contains a subgroup of finite index which 
is PSL2(R)'^-conjugate to a subgroup of finite index in one of the PSL2((9). Irre- 
ducible cocompact lattices in PSL2(R)'' are constructed from quaternion algebras 
over totally real number fields F. In case d >2 these are up to conjugacy the only 
examples, by Margulis' arithmeticity theorem. See Section|2]for more details. 

Let F c PSL2(R)'^ be an irreducible lattice and let z £ h'^ be fixed. Consider the 
set of vector valued distances 

(2) D(F, z)--{ diz, 7z)eMf' : y e F ). 

This clearly is an infinite discrete subset of R'^. But what more can be said? In this 
paper we shall prove results which describe the distribution of the points of D(F, z) 
in various regions hke strips or expanding polyhedra in R''. 

To give a precise formulation of our main results, we need to discuss some as- 
pects of the spectral theory of L^(F\§'^). This Hilbert space has an infinite dimen- 
sional subspace L^''^^^" {r\§)'^) with an orthonormal basis [ifrf] € N U |0)) of joint 
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eigenvectors of the Laplace operators Ay = -y^jd^^ - y^jdy. (j = 1, ... (i) in the fac- 
tors. Among the eigenfunctions is the constant function (Ao(z) = (vol(r\§'^))~'^^ 
for which the eigenvalues of all Ay are all equal to 0. The corresponding multi- 
eigenvalues Ac have finite multiplicities and form a discrete set in [0, oo^. For 
{ > I one knows that Acj > for all j = l,...,d. If F is cocompact, then 
^2,discr|-p\^^j-) is all of L^(F\§'^). Otherwise the elements of the orthogonal com- 
plement of L?''^^'^^'^(T\9>'^) can be described as sums of integrals of Eisenstein series. 

We call a multi-eigenvalue A( exceptional if < Ac^j < | for some coordinate j e 
{\,. . . ,d}. \f d > 2, there may be infinitely many exceptional eigenvalues, since 
there is no bound on the other coordinates. If < A[j < | for all j we call A[ totally 
exceptional. There are at most finitely many totally exceptional eigenvalues. 

For a further discussion we use the parametrization A = | - by the spectral 
parameter t. In L^(F\§'^) all eigenvalues of local Laplace operators are in [0, oo), 
so we can choose t € /[O, oo) u [0, j\. Thus we have tqj - j for all j, and 
Re Tej < \ for all / 

For a congruence subgroup F of a Hilbert modular group it has been shown by 
Kim and Shahidi, [13], that Rer^j- < 5 for all /' > 1 and all j. For this situation a 
conjecture called after Selberg says that Re y = for all ^ > 1 and all j. Below 
we will discuss other results concerning RcTf y, i > \. For the formulation of our 
results we summarize the information concerning exceptional eigenvalues in the 
quantity 

(3) f = f(F) := sup Rer^j. 

e>\, \<j<d 

This, by definition, is an element of [0, Since there may be infinitely many Ac, 
the value 5 might occur in (O, although here we omit ( - O.If ^ < 5 one says 
that F\§'^ has a strong spectral gap. In our later arguments we use that f < ^, a 
fact proved in 1 12.1 by Kelmer and Sarnak for cocompact F. If F is not cocompact 
and d > 2 then F contains a subgroup of finite index which is conjugate to a 
congruence subgroup of a Hilbert modular group SL2(<9), for which the results of 
Kim and Shahidi, |,13i1 . imply that t < ^. Here we use the important fact, proved 
in ||26l that every subgroup of finite index in SL2((9) is a congruence subgroup. 

Let now E cz { 1, . . . , be a non-empty subset and let I := {Ij : j € £ ) be a set 
of bounded intervals /y := [Ay, By) c [0, 00). Define for T > 

(4) S{E, /; r) { (xi, . . . x^) e Mf' : xy € /y for jeE,0<Xj<T forj ^E}. 

We think of S{E,I; T) as a strip of increasing height T in R''. Given z e ^'^ we 
introduce the counting quantity 

(5) NE{z\T):=#[yeY : d{z,yz) e S{E,I-T)}. 
We show 

Theorem 1.1. Let F be an irreducible lattice in PSL2(1R.)^, with d > 2. Let E c 
{ 1, . . . , <i) be a subset with e :- #E > 1. Define Q :- {I,. . . ,d} \ E and assume 
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+ < 



q :- #Q > 1. Let finite intervals [Ay, Bj) c [0, oo) be given for j e E, the quantity 
Ne(z', T) in ^ satisfies as T ^ oo.- 

Or,.(Kz)exp(^,r)) ifr^^^y 
I l\+lf + e\\ q 1 

This is a specialization of Theorem 15 .Si where we allow somewhat more general 
conditions on the components of the vector valued distances. The E in Or,£ implies 
an implicit dependence on the intervals {Aj,Bj) with j e E. In Theorem 1 1.1 1 we 
have d > 2 and I < q - #Q < d - \. As explained above t < ^ holds and it 
depends on the relative sizes of d and q which of the error terms is applicable. 

We shall describe now another result pertaining to the more standard lattice 
point problems. We consider the asymptotic distribution of the orbit points yz 
(y € F) for a given point z € X and a discontinuous group of motions F acting on a 
symmetric space X. In the case when X = § is the upper half plane many authors 
have contributed to this problem, for instance flOl . EOl and ITTl . The best result 
concerning error terms is due to Selberg (see the Bombay and Gottingen lectures 
in i25 1). It gives 

^ #|reF:d(,.,.).ri = -^.^ 

Zj F(t^ + 3/2) V ; V 

The functions if/j form an finite orthonormal system (possibly empty) of eigenfunc- 
tions with eigenvalue | - of the hyperbolic Laplace operator acting on L^(F\§) 
with < < |. This result holds for all cofinite discrete subgroups of PSL2(R), 
cocompact or not. 

Let F now be an irreducible lattice in PSL2(R)'^, with d e N. For z € ^'^ we 
define 

(7) A^(z; T)--# (D(F, z)n{xeR'' : max(.x) <T}) 

where max{x) is the maximum of the absolute values of the coordinates of the 
vector X e and D(F,z) is defined in Q. We show 

Theorem 1.2. Let F be an irreducible lattice in PSL2(M.)'', with <i e M and let 
Z E be given. With f = f(F) as in and with the quantity n{z) as defined 
in (I16I ). the counting function N{z:, T) has the following asymptotic behavior as 

T — > CX3.' 

• IfO< f(F) < 2(d+2) (l^gs spectral gap), then 
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• If 2(d^2) - - h (small spectral gap), then 

voi(r\§^) ^^^^^^Aj^^^^^^^^i i.^i\r(3/2 + T,,;) J 

'2d + l{d -l)f ^ 



I /2d + 2(d-l)f \\ 
+ Oriniz) exp( ^rj) . 



Theorem 11.21 is a special case of Theorem I5.4[ where we allow a more general 
counting quantity than N{z; T). The function n{z) in ([T6l ) is positive on r\§'^ and 
grows when z approaches a cusp. 

We note that we do not try to put one distance function on but work with the 
vector of the distances in the factors. Partly, this is because in this way it is easier 
to apply the spectral theory. Partly, it reflects the fact that there is not one distance 
function on 9)'^ that is preserved by the action of PSL2(1.)'^', but infinitely many. 

For a small spectral gap totally exceptional eigenfunctions appear explicitly in 
the asymptotic estimate. Of course, some of these exceptional contributions may 
happen to be absorbed by the error term. For large spectral gaps, further improve- 
ment of our knowledge of f(Y) does not improve the quality of the error term in 
our asymptotic formula. This holds in particular for the congruence case, in which 
we know that t < \- The main term is always larger than the error term, even if we 
would have f (F) = ^ (no spectral gap). 

The case d - \ m Theorem 1 1 . 21 concerns lattice point counting for groups acting 

It 

on the upper half plane. The best known error term 0{e 3 ) coincides with the error 
term in Theorem O for <i ^ 1. The papers |7|, | ll, fBl, HSl and IS treat lattice 
point counting for other symmetric spaces of rank one. The situation in this paper, 
with rank d, falls within the scope of Q and 161, in which Gorodnik and Nevo 
consider counting of lattice points over quite general families of sets in quotients 
of more general Lie groups. Their error terms for T\9)'' are weaker than those 
in Theorem 11.21 They get 0(exp(|r)) in the case d = \ and F not cocompact, 
and 0(exp(|^<ir)) for the Hilbert modular case and d > 2, which should be 
compared with Selberg's bound 0(|r)) for d = \, and with 0{exp{^^dT)) in 
Theorem 11.21 for general d. We emphasize that the class of counting problems 
considered by Gorodnik and Nevo is much larger than ours. They consider quite 
general families ? i-^ G, of regions in much more general groups than PSL2(R)'^, 
that have to grow in all directions. They use an ergodic method that can be applied 
in all these cases, without using more spectral information than the size of the 
spectral gap. The counting in Theorem 11.11 is over regions that are constant in 
some coordinate directions, and hence do not satisfy the conditions in [5|. 

In the proofs we apply the spectral theory of automorphic forms. We give the 
main proof in ^ The approach is sketched in the introduction to ^and in Sub- 
sections |5?I] and |521 The idea is that the sums N{z:, T) and Ne{z', T) are replaced 
by smooth approximations. This smoothness ensures that the new quantities have a 
spectral decomposition that converges pointwise. In this spectral expansion we sin- 
gle out the terms corresponding to the constant functions and to totally exceptional 
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eigenf unctions, if these are present. These give the main terms in the asymptotic 
expansion. The remaining part of the spectral decomposition is estimated using the 
estimate of the spectral measure in Theorem 14.21 We use an approach similar to 
one in [1 IJ that makes explicit the dependence on the point z € 

For the handling of the spectral decomposition the Selberg transform discussed 
in 94. II is essential. In ^we prove the estimates and other facts that we need. In 
the proof of the main theorems we also use some estimates of the counting function 
(Lemmas 13.11 and 13.21) obtained without the use of spectral theory. A main role in 
the proof is played by an estimate of the spectral function given in Theorem 14.21 
proved in 97.21 



2. Lie groups and discrete subgroups 

Let G be the Lie group PSL2(1.)'' for some integer d > I. The group G acts 
on the product of upper half planes by fractional linear transformations in each 
factor. We will use the letter j to index these factors. G leaves invariant the vector 
valued distance function 

(8) d(z,u;) = (dy(Z;, «;;•));•£, 

where dj is the hyperbolic distance in the j-th factor. By j we denote the class 

in G represented by ^) e SL2(R). 

We consider an irreducible lattice F c G, as described in Definition 5.20 and 
Corollary 5.21 of 1.22 j . So, for each of the genuine subproducts H of PSL2(]R)'' the 
projection F — > // has dense image. In particular F\§^ has finite volume, and the 
projection to each of the factors is injective on F. (See also Corollary 5.23 in loc. 
cit.) 

Hilbert modular groups PSL2((9) and their subgroups of finite index, mentioned 
in the introduction, are examples. Cases for which F\G is compact can be derived 
from quaternion algebras "K over a totally real number field F for which there is 
a non-empty set S of infinite places j for which the tensor product Fj '^p'H, with 
the completion Fj, is a division algebra. Suppose that #S = d > 0. Let 'Hq be an 
order in "K. Then the elements of reduced norm 1 in TYo have as their image in 
YijiS PSL2(F,) a cocompact discrete subgroup satisfying the assumptions above. 

In the case d = I most of the subgroups with finite index in PSL2(Z) are not 
the image of a congruence subgroup of SL2(Z). Moreover there many are irre- 
ducible discrete subgroups of PSL2(R.) that are not commensurable to PSL2(Z). 
For d >2, Margulis has shown that all irreducible discrete subgroups of PSL2(M.)^ 
are arithmetic, i.e., commensurable to a Hilbert modular group or to a unit group of 
a quaternion algebra. (See Theorem ( 1 . 1 1) in Chap. IX of lITSl . or the discussion in 
§7 of [24].) Serre, [26], has shown that all subgroups of finite index in SL2((9) are 
congruence subgroups. So all non-cocompact irreducible lattices contain a conju- 
gate of a congruence subgroup as a subgroup with finite index. 
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3. A PRIORI ESTIMATES 

From here on we follow the usual practice of not working directly with the 
hyperbolic distance d on §, but with 

u{z,z') - = (sinhid(z,z'))^ 

d{z,z) - 21og(VKz^+ V"(z,z')+ l)- 
For U,V € [0, oo)'^ such that Uj < Vj for all j, we consider the counting quantity 

(10) mU, V;z) - #|r e r : Uj < u{{yz)j,Zj) < Vj for all j} . 

To relate this to the quantities N{z', T) and Ne{z:, T) used in the introduction we will 
use that d i corresponds to m i in such a way that 

(11) u = — + 0(d'^), d - 2V" + 0(m^^^), 
and that u ^ oo corresponds to d ^ oo in such a way that 

(12) u = ^e'^ + Oi\), d - logM + log4 + 0(M-'). 

We will need a starting point for the estimation of N(f/, V; z). We give two esti- 
mates for the counting function. The first is based on a simple volume argument. 
The second is important for the dependence of our results on the geometry of r\§'^. 
As z € approaches a cusp there are more and more y € F for which yz is near z- 

Lemma 3.1. For z € 9)'^ and U,V € [0, oo)'^ such that Uj < Vjfor all j, we have 

N{U,V;z)«r,zY\(^j-Uj + ^y 
j 

Proof. For u; e and 5 > we put 

B{w, 6) = € §^ : u{wj, Vj) < 6} . 

Let z £ §^ be given. The subgroup Fj of F fixing z is finite. See, e.g., Re- 
mark 2.14 in [4]. By the discontinuity of the action there is 5 > such that 
B{z,5) n B{yz,6) = for all y e F \ F^. The F-invariance of u implies that 
S(yi , z, 5) n S(y2Z, 5) -% for all yi , y2 e F for which y\zi^ yiZ. 

For P,Q€ [0, oo)'' denote by A{P, Q) the multi-annulus 

{t;€§^ : yjPj<u{vj,Zj)<Qj]. 

The pairwise disjoint sets B(yz, S) with yz e FznA(?7, V) are contained in a slightly 
larger multi-annulus A{U{d), V{6)) with U{6)j = Uj - 0(1) and V{6)j = Vj + 0(1). 
See Thus we have 

#(Fz n A{U, V)) < voliA{U{d), V{S)))/vol{B{z, 6)) «5 Yl^Vj - Uj + 1) . 

j 
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(The volume computation is easiest in a distance coordinate u - u{z, i) and an 
angular coordinate (p. Then J/i on § is given by 4dud(p. See (1.17) in ifTTl .') Since 
N(?7, V; z) = #r^ • #(rz n A(U, V)), this proves the lemma. □ 

Next we aim at an estimate of N(z, w; 0, V) when all Vj are small. In this esti- 
mate, the dependence on z will be explicit. In order to do this, we take into account 
some facts concerning the geometry of the action of F on (The approach is 
motivated by that in the proof of Corollary 2. 12 in 1 11 ].) 

The assumptions on F imply that we can find a fundamental domain g that is 
compact in the case of cocompact F, and is contained in a union of Siegel domains 
otherwise: 

K 

S(X^, Y„ V,) = [z : Xj € [-X^, X,] for all ; , ym- ■ ■ yd > Y, , 
V;^ < — < K for 1 < 7 < - 1 

yj+i 

where k runs through a finite set of representatives k = gnoo of the F-classes of 
cusps, with g,, e G, X,,, > and > 1. (See [4], Chap. I, §2.) Enlarging 
decreases S(Xk, Y^, V^). There exists A > such that the ^(^©^(Xk, A, V^) are 
disjoint. For each B > A there is a compact set Cg such that 

(13) ^cCBu[jg,S{X„B,V,). 

K 

We fix a fundamental domain and a disjoint decomposition of it induced by ( [T3] ). 
and define F-invariant functions . . . , on § determined by the requirement that 
for z e g: 



(14) D/z) 



j 1 if F is cocompact, or if z e , 

[lm(g- J. Zj) iizeg, S(X^, A, K) . 

The product of the r)y(z) measures how far up in a cusp sector the point z is situated. 
Note that the i)^ may be discontinuous, but are bounded away from 0. 
For T e (0, oo)"^ we put 

(15) nj{Tj,z) = max(l,i)y(z)/ry), n{T,z) = Y\nj{Tj,z). 

j 

We take 

(16) n{z) = n{l,z) = Yl^^^i^'^M)) ' 

J 

with 1 = (1, 1, . . . , 1) e W^. The quantity n{z) occurs in the error terms in the final 
estimates in Theorems 15.41 and |5.5[ describing the dependence on z € 

Lemma 3.2. For all sufficiently small di > 0, . . . ,dci > 0, we have for € and 
6 = {6j)j: 

N(z;0,5) «r n{5-^l^,z). 
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where S-^'^ - )/■ 

Proof. It suffices to consider z in a fundamental domain g chosen as indicated 
above. As long as z stays in a compact region, the value of N(z; 0, 6) is at most 
the maximal order of totally elliptic elements of F provided we take the 5j > 
sufficiently small. In the previous proof we have seen that this maximal order is 
bounded for each Y. This proves the lemma for cocompact T. 

For other F we fix B > 2A. If z e Cb, with Cb as in (fT3] ). we have N(z; 0, 6) = 
Or(l) for all sufficiently small 6. Suppose now that z e gK'B{XK,B, V^). If the 5j 
are sufficiently small, then all y e F such that u{{yz)j, Zj) < Sj lie in F n P^, where 
Pk is the parabolic subgroup fixing k. 

For the remaining computations, we can assume that k = oo and = ^- Denote 
hy N - |[oi] ^ G] the unipotent radical of Poo - {[oi/f] ^ Elements in 
A^r ^ n F c F 

CO — Poo 

n F have the form [g 'j'] with co running through a lattice 
A c R''. The quotient Foo/A^r is represented by elements of the form [g "J^^^j, where 
a mod A is determined by e, and where e runs through a discrete subgroup of (R*)^ 
such that e^A = A, and such that the (log . . . , log le^l) run through a lattice in 
the hyperplane J^j xj = in R'^. 

We need a bound for the number of y € Too with 

(ej - \fy] + ((ej - 1)^7 + '^jf 
u{£j{zj + aj),Zj) = < dj, 

r } 

for 5j € (0, 1) for all j. Hence the following quantities have to be non-negative: 
(IV) A5je]y] - {e] - ify] ■ 

This implies 

log(l + 26 j - 2 + 5p < 2 log |ey| < log(l + 26 j + 2 ^6j + 6^j) . 

Since log |e| runs through a lattice in a hyperplane in R^, this leaves 0(1) possibil- 
ities for the choice of e. Taking the maximum of the quantity in ([TT] ). we find for 
all j: 

\{E]-l)xj + aj\ < 2^6j + 6]yj. 
Since a runs through a coset modulo the lattice A, this gives at most 

o(n^i+ v^^/i))«^"/'5T^/^z) 

possibilities for the choice of oj. 

For z £ Qii'^iXii, B, Vk) replace yi by Im g'\zi- Together with the bound 0(1) for 

J K,J J 

z e Cb,"^^ get the statement in the lemma. □ 
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4. The Selberg transform and spectral estimates 



If ki, . . . ,k^i are bounded functions on [0, oo) with compact support, then the sum 



converges absolutely, and defines a function on (r\§'^) x (r\§''). If we take each 
kj equal to the characteristic function of the interval [Uj, Vj), then 



It will turn out preferable to use smooth kj, so we will take for the kj approxima- 
tions of those characteristic functions. In this case K{z, z) is only an approximation 
of N(U, V; z), but its spectral expansion as an element of L^(r\§'^) converges point- 
wise, and we can write 



for each z € where i^expi(z> z) is the contribution to the spectral expansion of 
a finite number of i/'f (among them ipo), and where K'(z, z) is the remainder. The 
main idea is that A'expi(z, z) will yield the explicit terms in the asymptotic expansion 
of N(U, V; z), and that estimates of the difference K{z, z) - N(?7, V; z) and of K'{z, z) 
will contribute to the error term. 

To carry this out, we have to see how the spectral expansion depends on the 
functions kj. That leads us to a study of the Selberg transform ( 94. lb . We also 
have to know what is the size of the contributions of various parts of the spectrum 
( 94.31 ). In this section we state the results that we need, and refer for most proofs 
to gHand ^ 

4.1. The Selberg transform. We can do most of the work on factor by factor. 
So we work first on §. 

Functions k on [0, cxj) yield kernel operators on functions / on §: 



where duiw) = '^Rg"'^!'""' is the invariant measure associated to the Riemannian 



metric on §. We take k € C^[0, oo). (This implies in particular that all derivatives 
are well defined and continuous at m = 0.) We assume that the function / is 
continuous. That suffices for the convergence in (fT9l ). 

The Selberg transform associates to the function k e C^[0, cm) an even holo- 
morphic function /i on C, given by the following three steps: 



(18) 




K{z,z) = N([/,y;z). 



Kiz,z) = K,^piiz,z) + K'iz,z) 



(19) 




(20) 
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See, e.g., |fTTT|, p. 33, but note that Iwaniec uses ir as the variable in h. (See also 
ll23l .) The relation can be described in one step: 

(21) Kt) - r k{u{z,i))y^~^dfi{z), 

which can be made more explicit by use of a hypergeometric function 

(22) h{T) = An \ k{u) 2^1(5 +t,\- T\l\u)du . 

Jo 

See (1.62') and the proof of Theorem 1.16 in ifTTTl . In fact, h is the spherical 
transform of k. See, e.g., llT4l . Chap. V, §4. We have in particular 

(23) h{\) = 4n I k{u)du. 

Jo 

The Selberg transform has the important property that if A/ - i\ - T^)f, then 

(24) Lkf = h{t)f 
(Theorem 1.16 in ifTTl ). 

Next we consider hi,. . .,hd € C^[0, 00), and form the kernel function 

(25) k{z,w) = Y\kj{u{Zj,wj)) 

J 

on X Thus we have the operator 

(26) Lkfiz) - r k{z,w)f(w)d^i(w), 

with d}! = Yij d/Uj the product of the invariant measures. This converges absolutely 
if / is continuous on If moreover we have Ay/ = (| - "^y)/ for the local 
Laplace operators Ay = -yjf^ ~ ^/yfr^ then 

(27) AjiLkf) = hj{Tj)f for each;, 

where hj is the Selberg transform of hj. 
By Lemma [3?T] the sum 

(28) K{z,w) Yjk{yz,w) 

yeF 

converges absolutely, and defines a function in C°°{(T\§)'^) x (r\§'')) that satisfies 

(29) K{z,w) - 0,(1). 

The boundedness of K{z, w) is uniform for z varying in compact sets. If / is square 
integrable on T\9f' for the invariant measure djj. then 

(30) 7C,/(z) - r K{z,w)md^i(w) 
converges absolutely, and defines an operator 

n : L\r\?>'^) c~(r\§^) , 
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where / i-^ ^kf{z) is continuous on L^(r\§'^') for each z € 9/. 

4.2. Spectral decomposition. A consequence of the irreducibility assumption for 
the lattice T is that the spectral theory L^{r\^'^) is well known. The Hilbert space 
L^{r\^'^) = L^(Y\9/ ,dii) has a spectral decomposition in terms of automorphic 
forms. In the cocompact case, each element can be written in L^-sense as 



(31) 2]af(Af, 



where the tpt form a complete orthonormal system in L^(r\§'^) of simultaneous 
eigenfunctions of the A^: 

(32) = {\-Tlj)ilie, 

with tp j e i[0, oo)u(0, \]. Among these eigenfunctions we choose i//o - , ^ ■., 

'■' ^ V™i(r\5'') 

a constant function; hence tqj- - \ for all j. For each ^ > 1 we know that € 
/[O, oo) u (0, ^). The ai form a sequence in the Hilbert space t^. 

If r has cusps, there is a subspace L^''*''*"(r\§^) with the same structure as in the 
cocompact case. It always contains the constant function i/'q. If <i = 1 there may 
be finitely many ^ > 1 for which ip^ is a residue of an Eisenstein series and at most 
countably many x^ti that are cusp forms. The orthogonal complement L^''^°"'(r\§^) 
is a sum of direct integrals. Elements of this space can be written in L^-sense in 
the form 

(33) \ lc^ \ I b^^f,(t)E(K;itJiJ)dt . 

Here k runs over representatives of the finitely many cuspidal F-orbits, the are 
positive constants, is a lattice in the hyperplane Y^j = in 1.^, and E{k; s, ijj) 
is an Eisenstein series, satisfying 

^jE{K■, s, ijj.) = {^-{s + i^ijf)E{K; s, i/d) 

for each j. For / € L^(T\^'') we have a[ = (/, if/c). If / is bounded and sufficiently 
smooth, then b^^^ is given by integration against E{k; it, iji). 

The quantity f(F) - sup^>j i<;<rf ^^j' ® related to the quantity p(Y\G) e 
[2, oo) in Ha, with G - PSL2(IR)^, by 

(34) p(F\G) > -; or equivalently t < . 

i-f ^ ^ 2 pir\G) 

So f = ^ would imply p(r\G) = oo (no strong spectral gap), and p(r\G) = 2 
implies t = (no exceptional eigenvalues at all). We have to be careful to use 
inequalities in (l34l) . Kelmer and Sarnak take all irreducible representations of 
G = PSL2(R)'' in L^''''**"(F\G) into account. Such a representation is visible in 
^2,discr^p^^(i-j only if all d components of the representation have a non-trivial 
PS0(2)-invariant vector. We recall that in the congruence case (including all non- 
cocompact F if (i > 2) we have f(F) < ^. For all cocompact F we have f(F) < 
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We return to the kernel function K in (I28I ). By (1271) and the invariance of the 
kernel k(z., w), we have for fixed z € 

1 K{z,w)^{{w)d^i{w) = I k{z,w)if/c{w)diu{w) = h{Ti)^e{z), 



with 



(35) h{T) - Yl^jiTj). 

j 

Therefore the scalar product of K(z, •) with i/^f makes sense. If T is not cocom- 
pact, we find in a similar way that the coefficients bK^fj{t) in (l33l) are given by 
Yljhjiit + i/jj) E{K;it,ifi)- Thus we obtain the spectral expansion of K{z,-) e 

(36) K{z,-) = Y,^{TdJdz)^t 



h{it + ///) E{k\ it, z/i; z) E{k\ it, z//) dt . 



In the cocompact case, we understand the sum over k to be absent. 

This spectral expansion converges in the Hilbert space L^(r\§''). To use it to 
investigate the counting function N(?7, V; z) in the way indicated in the introduction 
of this section, we need it to make sense pointwise. 

Theorem 4.1. Let f e C^''{rW') be bounded, and suppose that the derivatives 
Aj' • • • /^'^ f are bounded for all choices of aj e {0, 1, 2}. Then the spectral 
expansion of f converges absolutely and uniformly on compacta. 

In particular, if the kj in (1251 ) are in C^[0, oo)for all j, then the expansion 

(37) K{z,w) = Y,KTe)Jdz)Mw) 

e 

poo 

+ y 2c K y I h(it + ip) E{k; it, ifi; z) E{k; it, ip; w) dt 

converges absolutely for each choice z,w e 

This result is more or less standard. We will sketch a proof in 97.11 

4.3. Spectral measure. As indicated in the introduction of this section, we will 
need to know how the various parts of the spectral set 



{iRu{0,^]f 



contribute to the spectral expansion of K{z,z)- We write iR instead of i[0, oo), since 
in the term in the spectral expansion (|37] ) corresponding to the continuous spectrum 
there are quantities / + pj^, which in some cases are in /(-oo, 0). 
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For X € [1, oo)'^ we put 
(38) Y(X) = Y](iO,^]^i(-Xj,Xj)y 



and define 

SiX;z,w) = ^Mw) 

e, treYiX) 

+ y 2c 1^ y I E{K;it,ifi;z) E{K;it,ifJ.',w)dt . 

K ^^Jt>OAt+lij)jeY(X) 

This is a smooth function on (r\$^) x (r\§^). (The sum over £ is finite. The region 
of integration is finite for all iK,fi), and empty for almost all {k,ij).) 

The following estimate of the spectral function S {X; z, z) will play an important 
role in ^in the proof of our main results: 

Theorem 4.2. For X e [1, oof and z € 

S{X-z,z)<^TXlx]---X]n{X,z). 



The quantity n{X, z) has been defined in (|16I ). It makes explicit the dependence 
of the spectral measure on the point z € §. This constitutes a difference with [2 |, 
where we used a result of Hormander to estimate the spectral measure uniformly 
for z in compact sets, obtaining an asymptotic formula for the lattice point count- 
ing function on symmetric spaces of rank one that was uniform for z varying in 
compact sets only. 

We prove Theorem l4.2l in 97.21 The proof uses the a priori estimate of the lattice 
point counting function in Lemma IX2l 

5. Proof of the lattice points theorems 

This section is the heart of this paper, where we carry out the plan sketched in the 
introduction of ^ We consider the asymptotic behavior of the quantity N(?7, V;z) 
defined in with U,V e [0,oo)^, Uj < Vj for all j. In Theorem El which 
is slightly more general than Theorem 1 1.21 in the introduction, all Vj tend to oo, 
whereas in Theorem 15.51 generalization of Theorem 11.11 some intervals [Uj,Vj) 
stay fixed. For most of the section we handle the proofs simultaneously. 

5.1. The main parameters. We partition the set {I, ... ,d} into two disjoint sub- 
sets Q and E, with the requirement that Q is non-empty. 

For each j e Qsnq. let Vj > 1 tend to oo, and choose Uj = or Uj = ^Vj. (This 
choice may depend on the place j e Q.) The simplest is to take all Vj with j e Q 
equal to each other. We wish also to include the case that Vj - T"' with positive 
exponent ay, where T tends to infinity. However, we do not let the Vj run apart too 
much, by fixing a parameter q satisfying 

(39) q>#Q, and require minVj = Y\^j- 
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Thus, if all Vj with j e Q are equal to each other, then q = #Q. For each j e E v/e 
keep the non-empty interval [U j, Vj) fixed. 

These are the parameters used in the Theorems 15.41 and l5.5[ They constitute the 
"main parameters" in Table [T] 



Main parameters 


Q 
E 


a non-empty subset of {I, ... ,d} 
the complement {I, . . . ,d] \ Q 




Vj>2, Vj^oc, 
Vj > fixed 




2; -0 (fixed), or Qj^^Vj^oo 
Uj € [0, Vj) fixed 


q 

^min 


q>#Q fixed , q log Vmin ^ ILjeQ log Vj 
Vmm = minygg Vj > 2 


Auxiliary parameters 


& 


^ € (0, 1) 


Ye 


Ye € (0, 1] , 7£ i 


Yj j^Q 
j^E 

c 


Yj = V^., Yj>l, y,-^oo 
Yj = YEiO 

0<c<i,iff>0 then c < f 



Table 1. Overview of the parameters in ^ 



5.2. Test functions and auxiliary parameters. In the introduction of ^we have 
sketched our plan to prove the main results in 95.71 and 15.81 We take the approx- 
imations hj e C^(0, oo) of the characteristic functions {U j, Vj) in the following 
way: 

< A: < 1, k^^ ^ 0,(F')for/eM, 



ki = 1 on 



\VUj + Yj,Vj-Yj] ifUj>0, 



(40) ^ \[0,Vj-Yj] ifUj = 0, 

kj = on 



[0, Uj - Yj] U [Vj + Yj, oo) if Uj>0, 
[Vj + Yj, oo) if Uj = 0. 
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The parameters Yj control how quickly kj changes from to 1 and back. We require 

(41) 7^. < ifUj>0, Yj<^-Vj ifUj = 0. 

If one fixes a smooth function co e C°°(]R) that increases from to 1 on an interval 
contained in (0, 1), then hj{u) = li){{u - Uj)/Yj) on [Uj, Uj + Yj] satisfies on this 
interval the condition on the derivatives, and goes from to 1. On [Vj - Yj, Vj] we 
proceed similarly. This gives a choice such that kj = outside [Uj, Vj]. We can 
equally well arrange that kj = 1 on [Uj, Vj]. 

The Yj are new parameters. They play a role in the proof, not in the theorems. 
At the end of the proof we try to choose them optimally. To avoid having to keep 
track of too many auxiliary parameters, we assume from the start that Yj = for 
j e Q, with ?9' € (0, 1) a single auxiliary parameter. So the Yj are large parameters 
for j € Q. 

We let the Yj with j € E tend to zero. It seems that we do not loose much if we 
take all these parameters equal to a quantity Ye tending to 0, for which we require 
that 2Ye < Vj - Uj for all j e E, and 2Ye < Uj for all jeE with Uj > 0. 

The estimates of Selberg transforms in ^ depend on a small positive param- 
eter c € (0, j). In Lemma [63] c) there is also a small positive parameter 6. We 
choose 6 such that 6 < Uj for all j € E with Uj > 0. The dependence on 5 of the 
implicit constants in the estimates is absorbed in the dependence of the choice of 
the intervals [Uj, Vj] with j € E. The positive constant c will turn up in exponents 
in some estimates. We take c < f if f > 0. (We recall that t measures the spectral 
gap, which is maximal if f = 0.) 



5.3. Terms in the asymptotic formula. With the test functions in (l40l ) we form 
the F-invariant kernel 

(42) K{z,w) - 2]^(i^(z,«;)), k{u) - ]~[^^'^"^'^' 

yer j 

as indicated in the introduction of ® The diagonal value K{z, z) gives an approx- 
imation of N{U, V;z)- By /j(t) = Yljhj{Tj) we denote the product of the Selberg 
transforms of the kj. 

From the absolutely convergent spectral decomposition in (|37] ) we single out 

(43) K,,pi{z,z) := h{To)—-^—j-+ V h{Tt)\Mzf ■ 

voUFxft") ^ , 

f>l , 0<rfj<i 



Here we have made the choice to take not only the contribution of the constant 
functions, but also all of the terms corresponding to totally exceptional eigenvalues. 
This term .S'expi(z, z) will lead to the explicit term in our asymptotic expansions. 
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As the explicit term in the final results we use 

^^^^ U ^^^—^^^(v^^^'-' 11^^^'-'^ 

where 

(45) r]{a,b;T) = f y^*^ d^iz) 

Jze^ , a<u(zj)<h 

is the Selberg transform of the characteristic function of [a, b). So we will need to 
estimate the difference between &{U, V; z) and A'expiCz, z)- We note that there might 
not exist totally exceptional eigenvalues for the group T. In that case &{U, V;z) is 
equal to the term for ^ = 0: 

(46) i — r (4^)"^ n(^/ - Ui) . 

voi(r\§^) i^.i^ ^' 

(See ([88]l in LemmaO) 

The remaining part of the spectral decomposition is split up according to subsets 
Z(n) of the space of spectral parameters. For « e N"^ we put 

Z{n) = {Te(/[0,cx,)u(0,^))'' : 

(47) Tj e i[-nj, 1 - rij] U i[nj - 1, «y) if tij > \ , 

T,€(0, ^)U/(-l,l)if«, = ij. 

For « € N'', « 7^ 1 = (1, 1, . . . , 1) we define 

|2 



Kn{z,z) = 2 h{Te)\Mz)f 



(48) 



V' 2ck V' I h(it + ///) \E(k; it, iji; z)p c/f . 



For n = 1 we modify the term from the discrete spectrum by requiring not only 
Tc € Z(l), but also Tfj € /[O, oo) for some j. (The totally exceptional terms go into 
&iU, V;z)-) With these definitions, we have 

(49) Kiz, Z) - ^expl(Z, Z) = ^niZ, Z) . 

It will be hard work to estimate this sum. 

Finally, we also will have to estimate the difference between K{z,z) and the 
counting quantity 'H{U,V;z)- Table [2] gives an overview of the estimates to be 
carried out. 
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N([/, V; z) = &iU, V; z) + OiErri + Err2 + Err^) 
Err\ estimate of Y,nei¥ Kn{z, z) in ^531 

Err2 estimate of K^^piiz,z) - S(U,V;z) in Q 
Err3 estimate of N{U,V;z)-K{z,z) in 
Table 2. Overview of the error term estimates. 

5.4. The explicit term. The explicit term S(U, V;z) in (|44l) is a finite sum. Each 
of its terms contains as a factor, for j € E, the Selberg transform r]{Uj, Vf, tcj) of 
the characteristic function of [Uj, Vj), and, for j e Q, the approximation of this 
Selberg transform given in ( |90l ) in Lemma \67\] That approximation is uniform 
on intervals [c, ^] for each c > 0. Here we want to apply it with r equal to the 
coordinates tcj of the totally exceptional eigenvalues. These coordinates form a 
finite subset of (0, ^). We take c € (0, ^) smaller than the minimum of these finitely 
many tcj, and then apply ( |90l ) uniformly. Thus, this parameter c depends on the 
group F, and will lead to an implicit dependence of the error terms on F. 

Lemma 5.1. The explicit term satisfies 

(50) &{U, V- z) - K,,piiz, z) «r,E n(z) (<"' + Ye) ]~[ Vj . 

The factor n{z) has been defined in (1161 ). See Table\J]for Ye, Vmin cind ■&. The E in 
•^Y,E indicates an implicit dependence on all Uj and Vj with j € E. 

Proof. For each of the finitely many t = tc occurring in £{U, V;z) and Ks^pi{z,z), 

we have by Lemma [63] a): 

(51) 

n - n ''j^^j^ « T,(^(uj, Vf, - hjiTj)) 2] rjiuj, Vf . 

J J J l*j 

We apply Lemmas |6. 1 1 and [d!2l with c € (0, j) chosen so that c < T(j for all j for 
all { occurring in the explicit term. We find, uniformly for c < tj < ^: 

jeQ: 7]iUj, Vf tj) - hj{Tj) «, YjV]'~'' = V"f^~^- LemmalSJc) , 

r]{Uj,VfTj) «, V]'^^ m, 

j € E : T](Uj,VfTj)-hjiTj) ^E Yj = Ye Lemma[Oc), 

riiUj,VfTj) «E 1. 

Note that we leave implicit the influence of the fixed quantities Uj and Vj with 
j € E, but keep their difference Yj explicit. The difference in (|5T]) is estimated by 
the following quantity, uniformly in the t = T[ under consideration: 

«r.. 2 "^r^ ■ n • 0(1) + z • n • 
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+ Yf 



n 

/eg 



where we have used Ty < ^ in the last step. 

We still have to estimate the finitely many iptiz)- If ^{ is a cusp form or if ^ = 0, 
then \ilJe{z)\ = Or(l). If tfrt, with £ > I, arises from a residue of an Eisenstein series, 
it satisfies ifreig^z) = 0{N{y)^~^'^) as N(y) = YljUj ~^ °° for cusps k, for some 
pt € (0, Hence \if/c{z)\ «(z)'^^. Since the explicit term and Ke{z,z) run over 
finitely many £, this estimate can be used uniformly, thus giving the lemma. Note 
that here arises another implicit dependence of the error terms on the group T. □ 

5.5. Sum over the spectrum. We turn to the estimation of Y,nei¥ K„{z, z), as de- 
fined in (|48] ). with the given modification for n = I. We will use that 



(52) K„iz,z) < M{n)S„, 

where, with Z{n) as defined in (|47] ) 



(53) 
(54) 



M{n) - sup |/j(t)| , 

TeZ(n) 



C>l,TceZ{n) 



\Mz)f 



+ 



h>Q,{iit+^ij))jeZ{n) 



\E{K;it,ifi;z)\^ dt . 



Lemma 5.2. For each sufficiently small c € (0, 5) the quantity M{n) has for each 
n eM"^ and each I eM"^ an estimate 



M{n) <^Ej,c W fljjifij) , 



where for all I € 



(55) 



fijin) 



1 



if j € Q and f > , 

if j € Q and f = , 
ifj^E, 



-2Y 



\-ly'--2 



if j e Q and n> 2, 
if j € E and n> 2 . 



lfE = % and f > 0, we have the slightly better estimate 

(56) Mil) «, r^Wf^^jW. 



We recall that f € [0, ^] is the supremum of the real parts Rer^ y, £ > 1, of the 
spectral parameters. It measures the spectral gap. 
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Proof. If t > 0, we take c € (0, f). We use the estimates in ^of the Selberg 
transforms hj of the kj with this value. 

If n = 1 we have to consider tj € (0, f) U /[-1, 1]. For r € [c, j), which can 
occur only if f > 0, we use Lemma [d!2l c) and ( |90l ) in Lemma [STT] to get 



hj{Tj) «, V/ ''+Yjm, 



with 



m 



max(v7 ~-,U:~-)ifUi > 0, 



m 



max{V.-,v''.' if Uj = 0. 



If j e Q we get a bound by OCVj^ - ) - 0( Vj ^ ). For j & E the dependence on 
and Vj is left implicit, so we can use the bound 1. If \Tj\ < c, Lemma [63] b) gives 

the bound 0,iV . ^) for j € Q, and Oc,e if j e E. For tj € iR, c < |Ty| < 1, we use 
Lemma [63] c) with 1=1. For j € E we take care to choose the 6 in Lemma [63] 

such that Uj >Sif Uj > 0. We use that k' « 7"^ to find 0{vj) if j € Q and 0(1) 
if jeE. 

If n > 2 we use Lemma 16.3! c) and the condition k''j^ = 0(F~') to obtain the 
bounds by fijin). 

In the case of M(l) we have the additional information that tj € /[-1, 1] for at 
least one j. If £" = this leads to the estimate in ( [56] ). □ 



The problem with S„ in (1541) is that we do not have a direct estimate for it. All 
we have is Theorem 14.21 which gives 

(57) ^ S„t n{n,z)Y\nj ^ ]~[ max(?i^, i)/2) «y) . 

meW jmj<nj j j 

(See ([T5] ) for n{n, z).) So we need to carry out a <i-dimensional partial summation. 
Lemma 5.3. Let z € §. For c € (0, A) in the previous lemma, we have iff>0 



(58) Yj ^"(2' 2) «r,£,. 



y/ Ylmy-' 



mm 



yc-T 
mm 



n'; 



2 



and iff = 

(59) Yj «r,£,c n{z)- 




1 - 2f, 

if§>\- If 

and E + % , 
if I -2f<-&<\ -2c 

and E = % , 

if§>\- 2c 
and E = d), 

if&<\-2c, 
if&>\-2c. 
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Proof. We have 5„ = I,hc[\,...4]{-W'' S{Y{n - l//);z,z), where Ih e N^q ^as 
coordinate 1 if j € // and coordinate otherwise. We understand that S{Y{m);z,z) 
is zero if one of the coordinates of m vanishes. 
To estimate X„ Kn{z, z) it suffices to consider 

(60) 2] 5(y(m);z,z) ^ (-l)#^M(m + 1^) . 

For S{Y{m); z, z) we have an estimate with product structure. Lemma [S!2] estimates 
M{n) also by a product over the places, with the exception of « = 1 in some cases. 
To handle that exception we take subsums Tf of (l60l ) characterized by nij > 2 if 
and only if j e F, with F running over the nonempty subsets of 1 1, . . . , <i). 

Tf <^rEj,c ^ max{mj,x)j{z)mj) 

mel¥ , mj>2o jeF 

Hc{l,...,d] jsH jm 

(61) "02] max(m5, i)/z) mj){fij{mj) - fij{mj + 1)) 

jeF mj>2 

•]~[max(l,i)/z))(//j(l)-/;,/2)). 

For each 7 and each mj we will choose a value of Z in fij(mj). Since the implicit 
constant in the estimate depends on /, we have to choose the / from a finite set in N. 
For "small values" of my > 2 we take 1=1, and / = 3 for "large" values. We will 
determine the boundary between small and large in a moment. If my = 1, /y,/(l) 
does not depend on /. 
For j e F, the sum 

^ max{mj,T)j{z)mj){fij{mj) - fijimj + 1)) 

mj>2 

has two critical values of my. The first occurs near my w r)y(z)- The other one, which 
we denote by Ay occurs where /i y(my) w /s y(my). We take / = 3 for m > Ay + 1 
and / = 1 for 2 < my < Ay, with Ay - [Vy/Fy] = [V]"*] if 7 e 2 and Ay - [F"'] 
for j € £. The choices of the parameters in 95. H and 95.2l is such that Ay is a large 
quantity in all cases. 

With the notations Py = Vj'^, P2 = VJ~^^ if j e 2, and Pi - 1, P2 = if 
j € E, the sum for 7 e F is equal to 

^ max(m^, i)y(z) m){m~^ - (m + l)~*)Pi 

2<m<A;-l 

(62) + max(A2, i5y(z) Ay)(A:^/'i - (Ay + 1)-^P2) 

+ ^ max(m^, X)j{z)m){m'i - (m + 1)"^)P2 ■ 

ni>A,+I 
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If r)y(z) > Aj, the first of the sums is estimated by 

2<m<Aj-l 

If < we split up the first sum, and obtain 

2 m~hi+ m--2Pi ^ x)j{z)Pi+AjPi. 

2<m<iy(z) ^j{z)<m<Aj-l 

For the last sum we obtain if ^jiz) > Aj 

2 r)jiz)m-ip2+ 'n'^-Pi « ^Jj{z)Ay-P2 + i-)jiz)-iP2, 

Aj+l<m<iyiz) m>r,j(z) 

and if i)y(z) < Aj 

Y m-iPi « ^~j^P2. 

m>Aj+l 

The transitional middle term in (l62l ) can be estimated by 

m?OL{Aj,X)j{z))A~hi. 
In total we get for i)y(z) > Aj 

« + AT^Pz) + r)j{zr^-P2 + i-)j(z)AyPi 

^ i^jizwj + vf if J € e , 

and for i)y(z) < Aj 

« X)j{z)Pi +A^jPy +Ay-P2+A]Pi 

r)jiz)Vj + V^-'"^ if jeQ, 
r)jiz) + Y~'' if j€E. 

_i 1--?? 

In the case r)j{z) > Aj we use that \)j{z) 2 VJ < V ■ ^ in the case jeQ and 
y| ^ for J ^ to following bound for the quantity in (l62l ): 

|:)/z)V/+^V;~^'' ifjee, 

|i)/z) + }'7 ifj££, 

nj{V}^'\z)v] if jeQ, 

nj{Y],Kz)Y~j} if jeE. 
So this estimates the factors with 7 e in (|6T| ). 



(63) 
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We estimate the factors for j ^ Fhy nj{z)fij{l). By Lemma l5!2l we get 

jeFnQ ieQ\F 

■ n "X^/'^)^/ n 1- 

jeFnE jsE\F 

Since we have already n{z) in the error term in Lemma |5.1[ it seems sensible to 
replace nj{*,z) by nj{\,z) in these estimates. So we put n{z) in front, and remove 
the nj{- • ■ ) from the products. 

The next step is to determine which non-empty F cz {I, . . . ,d] has the maximal 
contribution. The factors for j € E are maximal if j € F. So we consider F D E. 
The factors for j e Q are maximal for j ^ F if > 1-2 max(c, f ), and maximal 
for j € F otherwise. If £ = 0, we have to put one place in F anyhow, which gives 
the maximal contribution if Vj = Vmin- We find the following maximal value: 

Y~J^^ UjeQ y™''^"'^^^^ if 7? > 1 - 2 max(c, f) and £ ^ , 

nizW^in - UjeQ Vj if > 1 - 2 max(c, r) and #Q = d , 

— -#F 1— ij?- 

n{z) Yj, ' UjeQnF Vj ' if&<\-2 max(c, t) . 



(65) 



In the latter case, the maximum is attained for F = {I,. . . ,d], and in the former 
case for F = E, li E + %. If £" = 0, one place has to be in F, and j such that 
Vj = Vmia gives the maximal value. 

Finally we have to consider the term with m -\m (l60l) . It is estimated by 



max(c,f)+i 




(66) S(F(l);z,z)M(l) «?i(z) 



If £" or if 7? < 1-2 max(c, f) this is absorbed in the term that we have already 
obtained. In the case E - % and > 1 - 2 max(c, f ) we have to compare the factors 
4-max(c,f)-^^ and y^-,'^^^^''^\ If t = 0, we have max(c,f) - c, in which case 

mm mm ' v 5 / > 

the latter factor, ■ = 1, is the largest. In the remaining case there is another 

' mm ' 

transition point at = 1 - 2c. 

This leads to the statements in the lemma. We resist the temptation to simplify 
the lemma by choosing c < ^ . That would cause a dependence of the implicit 
constant in the estimates on the auxiliary parameter §. □ 

5.6. Difference between sums with sharp and smooth bounds. We have ob- 
tained K{z,z) = S{U, V;z) + Err I + Err2 for the sum K{z,z) in (l42l ). the explicit 
term S{U, V; z) in (l44l ). with error terms Erri estimated in Lemma [5?T] and Errj in 
Lemma [531 The sum K{z,z) depends on the choice of the local test functions kj 
as indicated in (l40l ). In particular the estimate is valid for the sum A'^(z, z) based 
on test functions with /c| = 1 on [Uj, Vj] for all j, and also for the sum K^{z,z) 
built with Supp(^J) c [Uj, Vk]- Since the characteristic function x of ny[f^y> Vj) 
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satisfies fly^J ^ Hj^)^ we have K^{z,z) < N{U, V;z) < K+{z,z). Thus we 
have also 

(67) N{U, V; z) = S{U, V; z) + Erri + Erri , 

with error terms satisfying the estimates in Lemmas [5.11 and [531 

5.7. Asymptotic estimate, case E - %. First we choose the auxiliary parameters 
in the case E - %. This leads to the asymptotic result in Theorem I5.4[ of which 
Theorem 1 1.21 is a special case. 

The auxiliary parameter € (0, 1) has to be adapted to the Vy to get the minimal 
value of the bound 



«r,( 



J 



'^ri; V] if 1? < 1 - 2 max(c, f) , 

max(i^,c)-f i+max(c,f) -4:0., o ^ -\ 

if 77 > 1 - 2 max(c, r) . 



+ n{z) 



mm 



The parameter c e (0, ^) is allowed to depend on F, but not on the Vj. We have 
assumed that 0<c<tiff>0. The Vj influence the estimate by their product 
Y[j Vj, which tends to oo. We have prescribed that the minimal Vj is coupled to 
the product by V^j^ - Y[j Vj, with q > d. (See (|39l).) Expressing the logarithm of 
the quantity to consider in terms of log Vmin, we arrive at the following quantity to 
minimize: 

max(?? - I + q, q - jq&) if & < 1-2 max(c, f ) , 

max(?? -l+q, f + (^ - l)f + max{^, c)) if > 1 - 2f , f > , 



(69) 

We choose < c < ^ in addition to the requirement that c < f if f > 0. 

If f = the value ??i for which {^i-l+q = q- ^q&i is ?9'i - Since 

I < 1 - 2c. Hence this is the c 
For f > we have {^i = and i?2 = 1 - 5^ + f (§ - 1)^; for the intersections 
of the graph of'&\-^{)^-\ + q with respectively, {)• q - ^q-^ and {)■ ^q -\- 
{q-\)f + -^Y^. If f < 2{^+2) ' ?9'i < 1 - 2f gives the optimal choice. Otherwise, 
??2 > 1 - 2f is optimal, since it is between 1 - 2f and 1 - 2c. 
This leads to the following optimal bound of the quantity in 1 



max(j? -\+q, q{\+c) + max(i^, c)) if > 1 - 2c , t - . 

^ 111 auuiiioii lu iiic icquiiciiiciii iiiai 

ui wmv^ii u\ — i-rq — q— ^ """^ ~ ^ 

q > d > 1, we have 7?i < | < 1 - 2c. Hence this is the optimal choice. 



q + \ q lit + 1) 2t q 

(70) q- ifO<f< , q— if t > . 

^ ' ^q + 2 - - l{q + l) ^ 3 3 ~ 2(^ + 2) 

Now we have chosen c depending only on quantities determined by F, and we have 
arrived at the following estimate: 



(71) N(i7,y;z)-£(C/,V;z) «r «(z) 



21i 



n • v if t < — 2— 

11; '^y 11 ' i 2(§+2) ' 
|(f+i)-ij « 

n ■ V ' if t > ^ 

[11; i^^-2(§+2)- 



NEW LATTICE POINT ASYMPTOTICS FOR PRODUCTS OF UPPER HALF PLANES 



25 



If there are totally exceptional eigenvalues, the explicit sum &{U,V;z) in (|44l) 

contains the corresponding terms, which are of the size 0(?i(z) n ; ^^^^)- Since 
Tcj < f for all exceptional coordinates, these terms are swallowed by the error 
term obtained for the case t < 2(^+2) • 

We have thus obtained the following asymptotic result for the counting function: 

Theorem 5.4. Let T be an irreducible lattice in PSL2(K.)^ with <i € N. Let f be the 
quantity in ([3]l, measuring the spectral gap. Denote by Vj > I, I < j < d, large 

quantities subject to the condition minj Vj = Yij^jfar a fixed number q > d. 
Choose Uj = or Uj = Vjfor each j = I, . . . ,d. 

Let z £ The number N(U, V;z) of y e T such that U j < u{{yz)j,Zj) < Vjfor 
all j, with u{-,-) as in satisfies 



+ Or(.(z) n Vf 

/ft > 2(^+2) ■ The factor n{z) is as in ([T6l) . 

Note that even if there is no spectral gap (t = ^) the error term is still smaller 
than the main term. 

In the special case when all Vy are equal to the same quantity V we have q = 
d. The relation ^ implies that the condition d{{yz)j,Zj) < T is equivalent to 
^{{7Z)j,Zj) < |e^(l + 0{e~^)). Thus, we obtain Theorem 1 1.21 

5.8. Asymptotic estimate, case E + We turn to the case when both parts of the 
partition {\,. . . ,d} - 2 U £ are non-empty. 

We have obtained the following estimate for the error terms: 

(74) «r,,^ .(z)«7i + Y,) W Vj + n(z)7;^*" ff y-^^^'^^-U..) _ 

We try to choose ■& and optimally, depending on the Vj, j € Q. The parameter 
c e (0, ^) satisfies c < t if f > 0, and can be further adapted to the situation, but is 
not allowed to depend on the Vj with j e Q. 
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We take x = log Vmin as the large variable. Then YljeQ - with q > q 
fixed. We assume that Ye with 77 > is a sensible choice. To simplify the 

formulas we work for the moment with the notations e = #E, m = max(c, f ). So 
< m < J. We try to choose ?? e [0, 1] and 77 > such that the following quantity 
is minimal: 



(75) 



M(77,7?) 



max\P - V+q,q-T]/-r] + ^(-^), + q(^+m 



id- - 1 



We allow for the moment ■& and 77 to assume boundary values. If we end up with 
an optimal choice on the boundary, we will see how to handle the problem of 
satisfying the conditions in 35.21 

The lines + ?/ = 1 and § - \ -2m give four subsets of the region in which 
(j], &) varies: 



l-2m 



We have 



M(t], 



\r] + q{^ + m)) 



max(^ - T], 
max(^ - 1 + ??, I77 + q{\ + m)) 



on A , 
onB 
on C , 
onD. 



max(^-?7, |?7 + ^(1 - §)) 
max{q-\+&, ^7] + q{l - f)) 

On B and D these expressions for M{r], &) contain 77 only once. So in the search 
for optimal values we can take 77 minimal in these cases. This brings them into the 
cases C and D, respectively. In region C, the variable & occurs only once. So it 
makes sense to take it optimal, i.e., ■& = I - 2m if < 77 < 277i and ■& = 1 - 77 if 
2771 < 77 < 1 . This reduces our search for the optimum to the lines E and F in the 
following figure. 

Ir 



l-2m 




2m 1 

Thus, we are left with a one-dimensional problem: Find the minimum for < 
77 < 1 of the maximum of the two functions 0^(77) = q - rj and 



Ur] + q{j+m) 
\h{e + q) + \q 



for < 77 < 2m, , 
for 2m < 77 < 1 . 
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(^+m)q-i-em 
(\+m)q 

2m i 

Since + m)q < q < q + j, the graphs of a and /3 intersect for some value of 77 in 
[0, 1]. This gives the value of the optimum we look for. This leads to the optimal 
value 



Ml 



e + 2 



q + e + 2'q + e + 2 



Ml 



( 1 - 2m)q 
e + 2 



, 1 - 2m = 



q + e + 2 
e + I + 2m 
e + 2 



if m < 



2{q + e + 2)' 



if m > 



2{q + e + 2) 



We note that if m - max(x, t) = j ('^o spectral gap), the optimal value is at the 
boundary point (0, 1), which we did not want to use. However, this optimal value is 
q > q, hence it provides an error term that swallows the main term. So we assume 
that t < ^ from this point on. 

If t > 0, we can just replace m by f in the results. If t = we take < c < 2(4%) ■ 
This depends on d, hence on F, and on the partition in Q and E. We now have 

q _1 2 + e 1 2 + e _#2 

"2 ^ 



2(q + e + 2) 



1 

2{q + 2 + e)~2~2{2 + e + #Q) 



2{d + e) 



> c 



m . 



So we can apply the estimate for m < 2{q+e+2) ■ 

Thus, we obtain the following estimates for the error terms: 



(76) 



Or^E(n{z) Y]vf'™^'''''') iff 



2(^ + 2 + #E) ' 



OrJniz) Y] V'j 



l+2f+#£)/(2+#£)\ 



if 1. <f<l 

2{q + 2 + #£■) 2 



and 



Each exceptional term in &(U, y;z) in (l44l ) contributes at most WjeQ 
is absorbed by the error term in (1761 ). We are left with the term corresponding to 
the constant function. See dSSl ) in Lemma [6TT] for its simple form. 

Thus we have obtained the following asymptotic result: 

Theorem 5.5. Let F be an irreducible lattice in PSL2(I8.) with d > 2. Suppose 
that the quantity f in ^ satisfies f(F) < ^. We partition the set [\,. . . ,d} into 
two disjoint non-empty subsets Q and E. For each j € E we fix a bounded in- 
terval [UVj] c [0, 00). For each j € Q, let Vj 00, under the assumption that 
minygg Vj = YijeQ ^jfar some fixed real number q > #Q. Also, choose U j = or 
Uj = \VjforjeQ. 
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Let z e §. The number N(U, V; z) in (fTOl) satisfies 



{4nf f4 



(77) 



r/ze implicit constants in the estimates depend on the discrete group Y, on the 
partition {\,. . .,d} = Qu E and on the choice of the intervals [Uj, Vj)for j € E. 

We note that the presence of totally exceptional eigenvalues for T has no explicit 
influence on this asymptotic formula. The size of he spectral gap does influence 
the quality of the error term only if it is larger than 2(q+2+#E) ■ 

Like we did in the previous subsection we take all Vj with j e Q equal to V, and 
all Uj for j e Q equal to 0. With the relation in I© between u{{yz)j,Zj) e [Uj, Vj) 
and the hyperbolic distance d{{yz)j,Zj) £ [Aj,Bj), the main term takes the form 

4*^7r'^' r~r + - e^> - e~^' 



e 



W 



in the notations of Theorem 11.11 which leads to the main term in the asymptotic 
formula in that theorem. For the error terms we use that for equal Vj for j e Q, the 
parameter q is equal to #Q. 

6. Estimates of Selberg transforms 

Here we collect and prove the estimates of Selberg transforms that we have used. 
This can be done factor by factor. So in this section we work on §, we do not use 
an index j and we denote real numbers by U and V. 

6.1. Integral representations. The results we need are given in Lemmas 16. 11 16.21 
and 16.31 To derive these lemmas we start with an arbitrary measurable compactly 
supported function k on [0, oo) with values in [0, 1]. By the definitions in 34. II we 
have the following integral representation for the Selberg transform hof k: 

r"' r"' du 
h{T) = 2 e'^ I k(u^ dr 

Jr=-c» JH=sinh^r/2 yj U — SAVih^ r j 1 

r°° r°° du 

(78) = 4 cosh rr ^ k(u^ dr 

Jo Ju=.smh-r/2 -VM~sinh^r/2 

The inner integral gives a non-negative compactly supported function. So /i(0) > 
\h{it)\ for f e R, which gives 

(79) \h{it)\ < h{0) (teW), t /j(t) is increasing on [0, 5] . 
(For the latter we use that t i-^ cosh rr is increasing.) 
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We interchange the order in the double integration, and obtain 
(80) hir) = 2 f k{u) f e'^ {u - ^m\? rjl)'^''^ dr du . 

Ju=0 JreR , sinh^ r/2<u 

Following the approach in flO^, we define x = x{u) > 1 by 2 + 4m = x + hence 
x{u) = \ + lu + 2 ^lu + u^. The condition sinh^ ^ < u amounts to |r| < log x. With 
the substitution e'' - x~^{\ + y{x^ - 1)) the inner integral equals 



= e"{{x + x-^ -e' - e-'yiA)-^'^ dr 

J -I 



-•log .X 
- log X 

pi 

(81) = 2X5-M (I + y(x^ - l)y-2(y^l _ dy 

Jo 

(82) = 2/^x5-^2^1(5 -T,^;l;l -x^), 

by the standard integral representation of the hypergeometric series in ||3l, §2.1.3, 
(10). Let us work under the standing assumption that < Rer < ^. 

From dRT] ) we obtain the bound 0(x^^^~5) for the inner integral in (I5U1 ). Hence 
if Supp(it) c [A, B], then 

x{B) , ^(-g^Rer+i _^(^)Rer+i 



Jx(A) 



h{T) « X'''^^^"5(/x « 



h(A) Re T + ^ 



(83) = (B - A) (1 + 2r + 2 + Tf^^~'^ withA<r<B 



1 , 



f(B-A)(l +Ai^"-t) ifA>0, 
l+fiRer+i ifA = OandB>0. 



Proceeding with (l82l ) we get 

k{{x + x"! - 2)/4) x-5-^ (x^ - 1) 
• 2^1(5 - T, 5; 1; 1 - x^)dx 

k{ix + x"i - 2)/4) x-'^-^ (x^ - 1) 



(85) 



• 2^^1(5 - T, 5; 1; 1 - x^)dx 
+ k{{x + x"^ - 2)/4) x~5 (x^ - 1)5 



Zr(±T) +^11 1 

(For ^ we have used a Kummer relation, fT], §2.9, (34), (10), (13).) 

Let us use (|85] ) in the case when Supp(fc) c [A, B]. For the part of [A, B] corre- 
sponding to a subinterval x e [1, 2] we have the estimates in ( [83] ). We now estimate 
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i) c < T < i 


ii) |r| < c 


iii) T = it 
€ iR \ (-C, c) 


a) 1 < A < B 


(B-A)A^~5 


{B-A)A'-'2 


\t\-^'^iB-A)A-'2 


b) < A < B < 1 


(B-A)A-5 


c) - A < B < 1 


B^ 


d) < A < B 


(B-A) 
• max(A'""2 , A~2) 


(B-A) 
■ maxCA'^"^ , A~2) 


(B - A)A-5 
• max(l,|fr5B) 


e) - A < B 


1 + B^+2 


1 + B''+5 


\ + \tr^B 



Table 3. Bounds for /j(t) under the assumption that Supp(^) c 
[A, B]. These bounds depend implicitly on c € (0, 



the integral over an interval [A, B] with x{A) > 2 by 

rxiB) 

x-2^^''\2F,il\;\+T;j^)\dx. 

JxiA) 

Uniformly for r in a compact set T we find an estimate by 

(B-A)A*'^"~5 . 

Note that this estimate is bad if t is near 0. To handle a neighborhood of t = 0, 
we consider the second integral in (l85l) as a holomorphic function of the complex 
variable r. It is holomorphic at t = 0, since the contributions of T{t) and r(-T) 
cancel each other. If Supp(/c) is contained in [A,B] with x(A) > 2, we find for 
|t| = c with a small c > by the reasoning that led to the estimate in (l86l ) a bound 

0,((B-A)A^-^). 

By holomorphy, this bound extends to |r| < c. Thus, if Supp(fc) c [A,B] with 
x(A) > 2, and if |t| < c, then 

h{T) «, {B-A) A'- -2. 
For T = it € iR with .x > 2 we use that 

\2F,i\,^;\±it;j^)\ < 2Fi(i,i;l; j^). 

— 1/2 ^ 

By Stirling's formula we get a bound (1 + \t\) (B - A) A" 2 uniformly on \t\ > c. 

In Table [3] we have combined these results. We will use these estimates repeat- 
edly in the proofs of the following lemmas. In some cases, we shall return to the 
integral representations. 



r(±T) 



(86) 



r(±T) 
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6.2. Lemmas for Selberg transforms. First we consider the Selberg transform 
r]{U, V;t) in (l45l) of the characteristic function of a bounded interval [U, V) c 
[0, oo). 

Lemma 6.1. 

(87) T h^T}{U, V; t) is positive and increasing on [0, ^] , 

(88) r]{U,V;\) = 47:{V - U) , 

(89) \T]{U,V;it)\ < T]{U,V;0) (teW). 

Moreover, if c € (0, ^) is fixed, then we have uniformly for c < r < ^ the estimate 

(90) r]{U, V;t) = ^ — --^ (V^+5 _ jj^^k) + 0,(y"^+5) {V ^ oo) . 

r(| + T) 

If the dilference V - U is small, then the 0-term may be larger than the explicit 
term in ( I9U1 ). 



Proof. We apply the computations in 96. ll to the characteristic function of \JJ, V). 
In we find ^ and Taking t = ^ in (gB gives ([Ml). 

For ( |90l ) we need an asymptotic formula, not an estimate. We use (1851 ). If x{U) > 
2, we need only the integral over [2, oo). Writing 2^^1(5 -t, ^; 1; l-x^) - 1 + 0(x~^) 
as ^ 00, we get, uniformly for t € [c, ^]: 



V r(i ± t) Jx(u) 



± r(f±T) 

For r > 1 we have x{T) = 4T + 0(1). So the main term with ± = + gives the 
exphcit term in dgO]). The other terms give Oilf'i) + 0(^5"^) = 0(V5-^). 
If x(U) < 2 we get from x e [2, 00) the contribution 

^ JX+T)_(^r+i _ Q(j)^ ^ 0(V5-^) . 
r(|+T) 

We add to it O {u{2) - U) = 0{\) from i)d) in Table [3 and obtain & in this case 
as well. □ 

Next we consider functions approximating the characteristic function of [U,V), 
satisfying the following conditions. 

k € C~[0,oo), 0<k<l, 

3y>o such that 2F < if > 0, 27 < y - U, and 



(91) ^ = Ion 

^ = on 



\[U + Y,V-Y] ifU>0, 
[[0,V-Y] if [7 = 0, 

l[0,U -Y]U[V + Y,oo) ifU>0, 
\[V + Y,oo) if [/ - . 
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Lemma 6.2. The Selberg transform h in (I20b of a function k e C°°[0, oo) satisfying 
the conditions (|9T]) has the following properties: 

a) An{V -U-2Y)< h{^) < 4n{V -U + 2Y). 

h)IfV< 1, then 



h{T) - 



« v^i^ 



for all T with < Re t < ' 



2- 

c) For each c € (0, ^) the difference with the Selberg transform ri{U, V', t) of 
the characteristic function of[U, V) satisfies the estimate 



?/([/, V;t)-/j(t)«, 



uniformly in t € [c, 



Fmax(V-5, ifU^O, 



2J 

Proof. Part a) follows by a comparison of k with the characteristic functions of the 
intervals [U + Y,V - Y) and [U, V), and an application of (1881 ) in Lemma [6^1 

For b) we use (|2TI ). and note that i/'' - 1 = - 1) (1 + ^{y - 1))*"' for some 
^ = £ (0, 1) to obtain 

\h{T) - hi^)\ <\1-t\ k{u{z, 0) \y -11(1+ ^(?/ - l)r^-'''' diiiz) . 

For small V the values of j/ that occur in the integral are between 1 - 0{\fV) and 1 + 
0(VV). Thus the integral is bounded by 0(W) k{u{z, /)) t//^(z), which gives b). 

For c) we apply the estimate i)d) in Table [3] to a function with support in the 
union of the intervals [U -Y,U + Y} and [V -Y,V + F]. For ?7 > we find: 

F max([/^~5,[/~5) + F max((y- F)^"5,(V- 7)-5) « F max(y^~5, . 

\iU = we have only the contribution of [V - F, V + F]. □ 

Lemma 6.3. The Selberg transform h of a function k e C°°[0, oo) satisfying the 
conditions ( 1911 ) has the following properties: 

a) h{T) = T]{U, V- t) + Yfor t € [0, \]. 

b) Let c € (0, i). Then we have, uniformly for t € /[-c, c] U (0, c]; 



h(T) «c 




1 < < V , 
ifU = Q, V>\, 

and, without dependence on c: 

h{T) « V . 

c) Let c € (0, i) an J fa^ce / € N. Then we have for each 5 > 0, uniformly for 



2> 

? e R \ (-C, c); 



h{it) <s: 



cj 



V||A:®||oo max(V'-5,[/-5)|r'"5 if6<U <V, 
F||^«IU max(V-5, j7[/ = 0, y>5. 
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We note that we have stated what we need, not the best estimate one might 
prove by separating more cases. In the proof we will see that in c) we have to 
avoid intervals with U € (0,5), to be able to apply an asymptotic estimate for 
hypergeometric functions. 

Proof. Part a) is a direct consequence of (|2T1) . the inequalities < k{u) < x(m)^ 
where is the characteristic function of {U, V), and Lemma [6n 

The first estimate in b) can be read off from Table [3] The bound /j(t) «: V 
follows from a) and (1881 ) in Lemma [6^1 

For d) we modify the discussion in 96.11 By the smoothness of k we find in (l20l) 

(92) q{p) - r k^'\u){u- pY'^du 

r{i + ^) Jp 

for each / e N. Proceeding as in we obtain 

V^(-i)' ^1 



r^«((x+x-^-2)/4) r 

+ t) Jx=l Ju=0 



22'r(/ + {) Jx=l Jy=0 

(93) • (x2 - l)2'+i (1 + y(x^ - l)y-'--2 (y(l - r^))'^ dy dx 
24' Z! 

• 2Fi{l + \ - T,l + \;2l + \; \ - x^) dx 

(94) ^ !^J%(0((;, + ,-i_2)/4).-§-3'- 



^ #((x + x'^ - 2)1 A) x-'2~^-' (x2 - l)2'+i 



)' 

24'/! _ 

. (->-2 _ 1 ^2/+l ^p. ('7 J. _ 



(;c2 _ ^-^21+1 2i7j(/ + 1 + + 1 . 2/ + 1; 1 - jc^^) 



2^' J2 r(/ + 5 ± r) 



• (x^ - l)'+5 2Fi(i - /, ^ + Z; 1 + r; (1 - x^)'^)dx . 

We apply this for t - it e ZR with |?| > c. Consider first an interval [U\, V\\ with 
1 < x{U{) < x{V\) < 2. Then we use the first integral in ( |94l ) to get a bound 

«/ ll^^'^llco \2Fi{l+\ + it,l+\;2l+\;\-x-'^)\dx. 

For > 1 + (5 > 1 we have by formulas (14) and (15) in §2.3.2 of 111 

2Fi(Z+i,Z+i + Zf;2Z+l;l-x-2) \t\-i-' . 

This gives a bound 

OiA\\k^'^Ux{Vi)-x{Ui))) 

« ll^®IU(Vi - t/i)(l + ^ ^ ) 



1 



« ll^®IU(Vi-t/i)y/ 
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We Stress that the use of 6 is critical for the apphcation of the asymptotic behavior 
from loc. cit. If we allow x to get down to 1 the implicit constant blows up. 

For an interval [U2, V2] with x(U2) > 2 we can use the second integral in ( |94l ). 
The hypergeometric series shows that 

|2Fi(i-/,i+Z;l+/f;(l-x2)-')| < iFyi^ + I, ^ + hl;{l - x^y^) , 
which is 0/(1) for x > 2. By Stirling's formula we get an estimate by 

Ol{\\k^'^\\oo\t\-'-^ X-^^'dx] « \\k^'^\\oo\t\-^--'iV2-U2)VP . 

^ Jx{U2 ' 

If [/ = we have only to estimate the integral over [V - 7, V + 7]. This gives the 
bound Y\\k^\oo max(V-5, ^'"5). \fU>6, we get from the interval [U -Y,U + Y] 
the bound y||/:^'^||oo max(?7''''2, J7~2). Together with the bound for the interval 
[y - F, V + F] we get the other bound in c) of the lemma. 

□ 



7. Spectral theory 

7.1. Spectral expansion. The point wise convergence of the spectral expansion 
of sufficiently differentiable elements of L^(r\§'^) in Theorem 14.11 is similar to 
well known facts for the case d - \ {e.g.. Theorems 4.7 and 7.4 in [11]), and for 
rank-one Lie groups (Lemma 2.2 in |T51). We sketch how to obtain the pointwise 
convergence in Theorem l4.1l in the present context. 

We consider first the mechanism of the Selberg transform on §, given in ^A.\\ 
We replace k € C^^IO, 00) by 

(95) r,{u) ^ ^^'^^\ u~'2Fi{s, s; 2s; -\/u), 

47rr(5) 

with Re 5 > 1 . It has a logarithmic singularity at m = and its support is not 
compact. Nevertheless, it determines a kernel function (z, w) i-> rs{u{z, w)) on § 
such that the corresponding convolution operator : / i-> R^f is well defined for 
bounded / e C°°($). It is in fact the free space resolvent on §, and satisfies 

(96) R,{^-s + s^)f = f. 

See §1.9 of ifTTI . If a,s € C both have real part larger than 1, the difference 
f's,a - - Ta has no singularity at m = 0, and has the Selberg transform 



(97) h,,a{t) 



2 2 

s - a + a 



for I Im f| < Re 5 - ^. Moreover, the resolvent equation gives on bounded functions 
in C°°(§) such that A/ and A^/ are also bounded: 

(98) L,-^„ {^-s + /)( A -a + a^)f = {R, - Ra){A - s + s^){A -a + a^)f 
= {s - - a + a^)f . 
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Taking 5, a e with Re sj > 1, Reaj > \, sj aj for all j, we form 

ks,aiu{Z, W)) ^ Y\ rsj,aj{u{Zj, Wj))) = Y^{r,^{u{Zj, Wj)) - raj{u{Zj, Wj)^ , 

J J 
and obtain a kernel operator TC^^a on r\§'^' given by the kernel function 

We apply this operator to differentiable bounded functions / on r\§^ for which 
the derivatives A^' • • • A^J''/ are bounded for all choices bj € {0, 1,2). 

^ n 7 2 2 2T '^.v,a/l > 

A > {si - s\-ai+a\)--- (sd - s^^-ad + a^) 
/i = (Ai -si+s])--- (Ad - Sd + 5^)(Ai -ai+a\)--- (A,/ - aa + a]) f . 
Now we note that the values ^s.afiz) are given by a scalar product in L?{Y\9)''y. 



'Ks,afi{z) = (fuRsAz,-)) = (fuRsraiz,-)). 

Taking the scalar product is a continuous operation L^(r\§'^) — > C. Thus, using 
(l36l ) and ( |97l ) we conclude that the L^-expansion of fi is transformed in a pointwise 
expansion: 

(99) TCMz) = Y,^Uk)^ciz)af 

f 



hs,a{t + ^i) E{k; it, in; z) b^illit) dt ; 



s j - s^- - a; + a] 

J ^ J 



i/ {f. + {sj-\f)itj + {aj- 



h2 



where a^/^ ^ </i, (Af> and ^£^(0 ^ j^^^^ fi{z)E{K;it,ii^;z) d/^iz). Since /?,.„(z, w) 

is bounded for z € ^'^ uniformly in z in compact sets, the convergence of the 
expansion (l99l ) is also uniform on compact sets. 

For two times differentiable functions in L^(r\§'^) application of Aj changes 
in the spectral expansion into (| - /j.^ j)ai, and Z?^,^(f) into (| + (f + fij)^)bK,fi{t). 
Taking this into account, the pointwise spectral expansion of / takes the form 

Xoo 
E{K;it,ifi;z)b^At)dt. 

Now we turn to the sum in (l28l ) defining K{z, w). The sum is locally finite in w, 
uniform for z in a fixed compact set, and defines a smooth bounded differentiable 
function f : w K{z, w) with compact support modulo F. Its derivatives are 
bounded, uniform for z in compact sets, hence its spectral expansion in w converges 
pointwise. 
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7.2. Spectral measure. To prove Theorem l4.2l we use the estimate of the counting 
function in Lemma[3]2j and apply the mechanism of the Selberg transform. 

We take kj € C"[0,oo) that satisfy Q < kj < I, kj = I on [0,Tjj\ and kj = 
on [dj, oo) for quantities r] - {T]j)j and 6 = {6j)j with < rjj < 6j < ^ to be 
chosen later. We form k and K as in ( |25] ) and ( |28] ). We have seen in that 
K{z, •) e L^(r\§'^'). We shall give two inequalities in which the norm \\K{z, Olb 
occurs. 



We have 



ll^^fcOli = r \K{z,wfdiu{w) 
Jr\!.y 



^ I kiyz, w) k(6z, w) dji(w) 



k{6~ ^yz,6-^w) k{z, 6' ^ w) dfi{w) 



- / I Kyz, w) k{z, w) di^{w) . 

The second factor restricts the domain of integration to w with u{zj, wj) < dj for 
all j, and the first factor to w with udyz^j, wj) < dj for all j. For the hyperbolic 
distances this means that d{{yz)j,Zj) < 2uj, where uj corresponds to 6j according 
to the relation For small values we have dj ~ jvj. Hence u{yjZj,Zj) < Sj with 
6j ~ 46 j as 6j i 0. Hence, with 6 = (5j)j: 

(101) Il^(z,-)ll2 < N(z;0,§) r k{z,w)dKw) = N(z;0,5)n/j(i)- 

Note that Lemma [631 a) implies that Yljh{^) is a positive quantity between {4n)^ 
UjiSj-rij) and (471)'' UjSj. 

Let X e [1, oo)'^. We recall that in ^JE\i we have given a bounded subset of the 
spectral set depending on X. Theorem 14.11 implies that 

e 

\h{t + fi)f \E{K;it,in;zf dt 
> minmf : t e Y{X)] ( \Mzt 

e,t[eY{X) 

(102) + y 2c, y f \E(k; it, in; zf dt] . 
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To get a hold on a lower bound of h on Y{X), we use Lemma l6i2l b). For r e Y{X) 
it gives 

Hrj)-hji^-)\ « s'fXj, 

\hjiTj)\ > hji^) - 0(6]'%) = AniSj - rjj) - 0(6]'%) . 

We take r]j = ^6j, and Sj - eXj^ with e > sufficiently small to have \hj{Tj)\ > 6j. 
This gives 

mm[\h(Tt : t e Y{X)} > fl'^^^s)"- 

j 

Thus we obtain from (11021 ) the inequality 

(103) \\Kiz,-)\\l>cS{X;z,z) Y]hji^f , 

j 

for some positive constant ci, which does not depend on F. If the Xj are suffi- 
ciently large, the dj and the 6j are sufficiently small to apply Lemma [T2l By (11031) 
and (IIOII ) we get 

S{X;z,z) < ^Nfc0,5) Uhji^) 

■' J 
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